Exploring Multimodal 3D Interfaces

نویسنده

  • S. Augustine Su
چکیده

The Virtual Reality Lab at the Naval Research Laboratory has created a real-time, situational awareness virtual environment for battlefield visualization, termed the Dragon System [1]. The system is implemented on a workbench [2] and a CAVE-like immersive room [3]. It utilizes a virtual laser pointer metaphor for navigating and interacting with the terrain and objects; we implemented this metaphor with a hand-held joystick tracked with a 6-DOF magnetic tracker instrumented with several buttons [1]. Currently, we are extending this single-modal paradigm into various multimodal 3D interfaces, especially combining voice and gesture. Our objectives are exploring new multimodal interaction paradigms and understanding how users interact in virtual environments.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A New Trust Model for B2C E-Commerce Based on 3D User Interfaces

Lack of trust is one of the key bottle necks in e-commerce development. Nowadays many advanced technologies are trying to address the trust issues in e-commerce. One among them suggests using suitable user interfaces. This paper investigates the functionality and capabilities of 3D graphical user interfaces in regard to trust building in the customers of next generation of B2C e-commerce websit...

متن کامل

The 3D Augmented Mirror: A Multimodal Interface for Learning and Teaching String Instruments

Multimodal interfaces can open up new possibilities for music education, where the traditional model of teaching is based predominantly on verbal feedback. This paper explores the development and use of multimodal interfaces in novel tools to support music practice training. The design of multimodal interfaces for music education presents a challenge in several respects. One is the integration ...

متن کامل

Modeling of Modality Selection in Multimodal Human-Computer Interaction

Research Interests The main interest of my research is the development of model-based methods for simulation and automated usability prediction of multimodal interfaces. In particular I want to investigate how modality choice of users can be predicted and simulated by a computational model that estimates the quality of multimodal interfaces. Therefore I am also interested in exploring rules and...

متن کامل

Representing Spatial Information through Multimodal Interfaces

The research discussed here is a component of a larger study to explore the accessibility and usability of spatial data presented through multiple sensory modalities including haptic, auditory, and visual interfaces. Geographical Information Systems (GIS) and other computer-based tools for spatial display predominantly use vision to communicate information to the user, as sight is the spatial s...

متن کامل

Tangible Objects for the Acquisition of Multimodal Interaction Patterns

Multimodal user interfaces offer more intuitive interaction for end-users, however, usually only through predefined input schemes. This paper describes a user experiment for multimodal interaction pattern identification, using head gesture and speech inputs for a 3D graph manipulation. We show that a direct mapping between head gestures and the 3D object predominates, however even for such a si...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2000